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THE PRINCIPAL-AGENT PROBLEM WITH TIME INCONSISTENT 
UTILITY FUNCTIONS 

BOUALEM DJEHICHE AND PETER HELGESSON 


Abstract. In this paper we study a generalization of the continuous time Principal- 
Agent problem allowing for time inconsistent utility functions, for instance of 
mean-variance type. Using recent results on the Pontryagin maximum princi¬ 
ple for EBSDEs we suggest a method of characterizing optimal contracts for such 
models. To illustrate this we consider a fully solved explicit example in the linear 
quadratic setting. 
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1. Introduction 


Risk managemenf or fhe problem of finding an opfimal balance befween ex- 
pecfed refurns and risk faking is a cenfral fopic of research wifhin finance and 
economics. Applicafions such as porffolio optimization, opfimal slopping and 
liquidation problems have been of particular inferesf in fhe liferafure. In such 
applicafions if is common fo consider ufilify functions of mean-variance type. 
Mean-variance utility functions constitute an important subclass of fhe so called 
time inconsisfenf ufilify funcfions for which fhe Bellman principle of d 5 mamic pro¬ 
gramming does nof hold. Problems involving such ufilifies can fherefore nof be 
approached by fhe classical Hamilfon-Jacobi-Bellman equation. This quesfion has 
been addressed in Andersson and Djehiche |AD11|, Bjork and Murgoci | BM10[ , 
Bjork, Murgoci and Zhou | BMZ14| , Djehiche and Huang ]DH15[ , Ekeland and 
Lazrak ||EL06| and Ekeland and Pirvu jEP08|. In fhis paper we develop a mefhod 
of sfudying a mean-variance setting of fhe celebrafed Principal-Agenf problem by 
means of fhe sfochasfic generalization of Ponfryagin's maximum principle. 
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The precise structure of the Principal-Agent problem goes as follows: The prin¬ 
cipal employs an agenf fo manage a cerfain well-defined noisy assef over a fixed 
period of fime. In refum for his/her efforf fhe agenf receives a compensafion ac¬ 
cording fo some agreemenf, sef before fhe period sfarfs. If could for insfance in¬ 
volve a lump-sum paymenf af fhe end of fhe period, a confinuously paying cash¬ 
flow during fhe period, or bofh. Depending on whaf information fhe principle has 
at hand to form an agreemenf, one disfinguishes between two cases; the Full Infor¬ 
mation- and the Hidden Action-problem. The full information case differs from fhe 
hidden acfion case in fhat fhe principal can observe fhe acfions of fhe agenf in ad¬ 
dition fo fhe evolution of fhe assef. Therefore, under full information fhe principal 
is allowed to tailor a contract based on both outcome and effort, not only outcome 
as for hidden acfions. In bofh cases fhe confracf is consfrained by fhe agenf via a so 
called participation constraint, clarifying fhe minimum requiremenfs of fhe agenf fo 
engage in fhe projecf. Under hidden acfion fhe confracf is furfher consfrained by 
fhe incentive compatibility condition, meaning fhaf as soon as a confracf is assigned 
fhe agenf will acf as fo maximize his/her own ufilify and nof necessarily fhaf of 
fhe principal. 

The pioneering paper in which the Principal-Agent problem first appears is 
Holmstrom and Milgrom | HM87| . They study a time continuous model over a fi¬ 
nite period in which the principle and the agent both optimize exponential utility 
functions. The principal rewards the agent at the end of fhe period by a lump¬ 
sum payment. As a result they find fhaf fhe opfimal contracf is linear wifh respecf 
fo oufpuf. The paper |HM87[ is generalized in | SS93 j by Shaffler and Sung fo 
a mafhemafical framework fhaf uses mefhods from d 5 mamic programming and 
marfingale fheory fo characferize confracf opfimalify. 

The inferesf in confinuous fime models of fhe Principal-Agenf problem has 
grown subsfanfially since fhe firsf sfudies appeared. In | CWZ09| , | San08| , | Wes06| , 
I Will3j (only fo mention a few) fhe aufhors analyze confinuous fime models in a 
classical setting, i.e. having one principal and one agenf. Such models are also 
covered in the recent book | CZ131 by Cvitanic and Zhang. Other models such 
as various multiplayer versions have been studied for insfance in | Kanl3| and 
I KSS081 . 

Our goal is fo characferize opfimal confracfs in fhe classical setting of Principal- 
Agenf problem under hidden acfion for fime inconsisfenf ufilify functions. We 
consider two differenf modeling possibilities; Hidden Action in the weak formulation 
and Hidden Contract in the strong formulation. In fhe firsf model fhe agenf has full 
information of fhe mechanisms behind fhe cash-flow and fhe principal wishes fo 
minimize his/her mean-variance ufilify. In fhe laffer model fhe agenf does nof 
know the structure of fhe cash-flow and has fo profecf him/her-self from high 
levels of risk by an additional participation consfraint of variance t 5 rpe. To fhe 
besf of our knowledge fhis has nof previously been addressed in fhe liferafure. 
In order fo carry fhe program fhrough we use recent generalizations of Ponfrya- 
gin's stochastic maximum principle. The idea is fo consider fhe Principal-Agenf 
problem as a sequential optimization problem. We first consider the Agent's prob¬ 
lem of characterizing opfimal choice of efforf. Then we proceed fo fhe Principal's 
problem which, by incenfive compafibilify becomes a consfrained opfimal confrol 
problem of a forward-backward sfochasfic differential equation (from now on FB- 
SDE). A similar scheme was considered in | DH14| buf wifhouf fhe non-sfandard 
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mean-variance consideration. Optimal control with respect to mean-variance util¬ 
ity functions have previously been studied in for insfance Zhou and Li | ZLOOj and 
Andersson and Djehiche HADllj . 

In fhe presenf liferafure of fhe Principal-Agenf problem fhe paper closes! fo 
ours is I Will3J, in which a similar maximum principle approach is used. The sel¬ 
ling is classical (wifhouf lime inconsisfenf ufilify functions) and fhe aufhor finds 
a characferizafion for optimal choice of efforl in fhe Agenf's problem. The full 
model involving fhe consfrained Principal's problem, however, is nof considered. 
Our confribufion fo fhe existing liferafure should be regarded as mafhemafical 
rafher fhan economical. We presenf a general framework for solving a class of 
Principal-Agenf problems, wifhouf claiming or invesfigafing possible economical 
consequences. The main resulfs of our sfudy are presenfed in Theorem |4.3| and 
Theorem 4.4 in which a full characferizafion of optimal confracfs is sfafed for two 


differenl models. 

The paper is organized as follows: In Section 2 we infroduce fhe mafhemaf¬ 
ical machinery from stochastic optimal confrol fheory fhaf is necessary for our 
purposes. Mean-variance maximum principles are fhen derived in Section 3 by 
resulfs from Section 2 in fwo differenl buf relafed cases. Section 4 is devoted fo 
fif fhe mefhods from previous secfions info a Principle-Agenf framework. We con¬ 
sider fwo differenl models under Hidden Action and find necessary condifions for 
opfimalify. Finally in Section 5 we make fhe general scheme of Section 4 concrefe 
by a simple and fully solved example in fhe linear-quadratic (LQ)-seffing. 


2. Preliminaries 


Lef T > 0 be a fixed time horizon and (O, F, P) be a tillered probabilify space 
satisfying fhe usual condifions on which a 1-dimensional Brownian motion W = 
{Wf}f>o is defined. We lef F be fhe nafural filfrafion generated by W augmented 
by all P-null sefs A/jp, i.e. F = A't V A/p where Tt := (7({ Wg} : 0 < s < f). 

Consider fhe following confrol sysfem of mean-field fype: 

f dx{t) = b{t,x{t),E[x{t)],s{t))dt + o'{t,x{t),'E[x{t)])dWt, fe(0,T] 

\ x(0) = xo 


wifh a cosf functional of fhe form 

r rT 




f{t,x{t),E[x{t)],s{t))dt + h{x{T),E[x{T)]) 


( 2 . 1 ) 


where b : [0, T]xRxPxS—tP, u: [0, T]xPxP—tR,/: [0, T]xRxRxS—t 
R and fi : R x R —t R and S c R is a non-empfy subsef. The confrol s(-) is ad¬ 
missible if if is an F-adapfed and square-infegrable process faking values in S. We 
denofe fhe sef of all such admissible confrols by iS[0, T]. In order fo avoid tech¬ 
nicalities in regularify fhaf are irrelevanf for our purposes we slate fhe following 
assupmfion. 


Assumption 1. The functions b, cr, f and h are with respect to x and x, where x 
denotes the explicit dependence of E[x(-)]. Moreover, b, a, f and h and fheir firs! 
order derivatives wifh respecf fo x and x are bounded and continuous in x, x and 

s. 

We are inferesfed in fhe following optimal confrol problem: 
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Problem (S). Minimize over 5[0, T], 


Anys(-) e 5[0, T] satisfying 


J{s{-))= inf J(s(-)) 

s{-)eS[0,T] 


is called an optimal control and fhe corresponding x(-) is called fhe optimal state 
process. We will refer fo (x(-),s(-)) as an optimal pair. 


The following sfochasfic maximum principle for characferizing optimal pairs in 
problem (S) was found by Buckdahn, Djehiche and Li in |BDL11|. 


Theorem 2.1 (The Sfochasfic Maximum Principle). Let the conditions in Assumption 
1 hold and consider an optimal pair (x(-),s(-)) of problem (S). Then there exists a pair of 
processes {p{-),rj{-)) G L^(0, T;]R) x {L^{0,T; satisfying the adjoint equation 

dp{t) = - {bx{t,x{t),E[x{t)],s{t))p{t)+E[bx{t,x{t),E[x{t)],s{t))p{t)] 
+(Tx{t, x{t),E[x{t)])q{t) + E[crx{t, x{t),E[x{t)])q(t)] 

< -f:c{t,x{t),E[x{t)]),s{t)) - E[fjc{t,x{t),E[x{t)]),s{t))]} dt 

-\-qit)dWt, 

^ piT) = -h,{x{T),E[x{T)])-E[h,{x{T),E[x{T)])], 

( 2 . 2 ) 

such that 


s(f) = argmax'H(f,x(f),s,p(f),£?(f)), a.e. t e [0,T], P-a.s. (2.3) 

seS 

where the Hamiltonian function TL is given by 

'H{t,x,s,p,q) := b{t,x,E[x],s) ■ p + cr{t,x,E[x]) ■ q — f{t,x,E[x],s) (2.4) 

for {t,x,s,p,q) e [0, T] X ]R X S X IR X R. 


Remark 2.2. If is imporfanf fo remember fhaf Theorem |2. 1 1 merely sfafes a sef of 
necessary conditions for opfimalify in (S). If does nof claim fhe exisfence of an 
optimal confrol. Exisfence fheory of sfochasfic optimal confrols (bofh in fhe sfrong 
and fhe weak sense) has been a subjecf of sfudy since fhe sixfies (see e.g. | Kus65) ) 
and, at least in the case of sfrong solutions, fhe resulfs seem fo depend a lof upon 
fhe sfafemenf of fhe problem. In fhe weak sense an accounf of exisfence resulfs is 
fo be found in | YZ99[ (Theorem 5.3, p. 71). 


Remark 2.3. Resfricfing fhe space U fo be convex allows for a diffusion coefficient 
of fhe form a{t, x,E[x],s), wifhouf changing fhe conclusion of Theorem 2.1 In fhe 
case of a non-convex confrol space fhe sfochasfic maximum principle wifh con- 
frolled diffusion was proven in | Pen90| and requires fhe solufion of an addifional 
adjoinf BSDE. We choose fo leave fhis mosf general maximum principle as refer¬ 
ence in order fo keep fhe presenfafion clear. 


As poinfed ouf in Remark |2.2| if is a non-frivial fask fo prove fhe exisfence of 
an optimal pair (x( ),s( )) in a general sfochasfic confrol model. Under fhe addi¬ 
fional assumptions; 


Assumption 2. The control domain S is a convex body in ]R. The maps b, a and 
/ are locally Lipschitz in u and their derivatives in x and x are continuous in x, x 
and s. 

















THE PRINCIPAL-AGENT PROBLEM 


5 


the following theorem provides sufficient conditions for optimality in (S). 

Theorem 2.4 (Sufficient Conditions for Optimality). Under Assupmptions 1 and 2 
let {x{-),s{-),p{-),q{-)) be an admissible 4-tuple. Suppose that h is convex and further 
that 'H{t, ■,p{t),q{t)) is concave for all t e [0, T] P-a.s. and 

s{t) = argmax'H{t,x{t),E[x{t)],s,p{t),q{t)), a.e. t & [0,T], P-a.s. 
seS 

Then (x(-),s(-)) is an optimal pair for problem (S). 

The stochastic maximum principle has since the early days of the subject (in 
pioneering papers by e.g. Bismut | Bis781 and Bensoussan | Ben82| ) developed a lot 
and does by now apply to a wide range of problems more general than (S) (see for 
instance |Pen90j, | AD11| |BDL11|, |DTT14|). For our purposes we need a refined 
version of Theorem 2.1 characterizing optimal controls in a FBSDE-d 5 mamical set¬ 
ting under state constraints. More precisely we wish to consider a stochastic con¬ 
trol system of the form 

dx{t) = b{t,&{t),s{t))dt a{t,&{t))dWt 
dy{t) = -c{t,Q{t),s{t))dt + z{t)dWt (2.5) 

x(0) = xo, y(T) = q>(x{T)), 

where b,cr,c : [0, T] x x S —)• R and cp : R ^ R, with respect to a cost-functional 
of the form 


J(s(-)):=E 


Jo 


f(t,&it),sit))dt + h{x(T),E[x(T)])+g(yiO)) 


( 2 . 6 ) 


and a set of state constraints 

^ '^F(f,0(f),s(t))dt + H(x(T),E[x(T)]) + G(y(0)) 


E 


JO 


^ E 

[1 





E 

7 

V 

Jo 


f{t,&f),s(t))dt + hHx{T),E[xiT)])+g\y{0)) 

f\t,Q{t),s{t))dt + h\xiT),lE[x{T)])+g\y(0)) 

Jo 


(2.7) 


e A, 


/ 


for some closed and convex set A C R^ In the above expressions we have intro¬ 
duced 

0(t) := {x{t),y{t),z{t),E[x{t)],E[y{t)],E[z{t)]), 

in order to avoid unnecessarily heavy notation. The optimal control problem is: 

Problem (SC). Minimize ( |2.6| subject to the state constraints < |2.7[ | over the set 
S[0,T]. 

To get a good maximum principle for (SC) we require some further regularity con¬ 
ditions ensuring solvability of | |2.5|. Th ese conditions are listed in the following 
assumptions and can be found in |LL141. 


Assumption 3. The functions b, a, c are continuously differentiable and Lipschitz 
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continuous in 0, the functions h, g, h\ are continuously differentiable in x and y 
respectively, and they are bounded by C(1 + |x| + \y\ + |z| + |x| + \y\ + |z| + |s|), 
C(1 + |x|) and C(1 + |i/|) respectively 

Assumption 4. All derivatives in Assumption 4 are Lipschitz continuous and 
bounded. 


Assumption 5. For all 0 e s e 5, A(-,0,s) e L^(0,T;R^), where we have 
A{t,Q,s) := {c{t,&,s),b{t,&,s),cr{t,Q)) and 


l5.(0,T;R^) 


ji/;: [0,T] X n ^ R^ 


ip is F-adapted and E 



< 00 


and for each x G R, (p{x) G L^(n;R). Furthermore, there exists a constant C > 0 
such that 

{ |A(t,0i,s) — A(f,02,s)| <C|0i—02|, P-a.s. and for a.e. f G [0,T], 
\(p{xi) — Cp{X 2 )\ < C\xi — X 2 \, P-a.s, 
for all 01,02 G R^. 


Assumption 6. The functions A and q> satisfy the following monotonicity condi¬ 
tions: 

J E(A(t,0i,s) — A(t,02,s),0i — 02) </3E|0i — 02p, P-a.s 

[ {(p{Xi) - Cp{X2),X^-X 2 ) > y\xi-X2\^ 
for all 01,02 G R^, xi,X2 G R 


In the spirit of | LL14| we are now ready to formulate the state constrained sto¬ 
chastic maximum principle for fully coupled FBSDEs of mean-field t 5 rpe. 


Theorem 2.5 (The State Constrained Maximum Principle). Let Assumptions 3-6 hold 
and assume A C R* to be a closed and convex set. If {x{-),y{-),z{-),s{-)) is an optimal 
4-tuple of problem (SC), then there exists a vector (Aq, A) G R^+^ such that 

Ao>0, |Ao|2 + |A|2 = 1, (2.8) 


satisfying the transversality condition 


(A, — E 


[ Y{t,x{t),y{t),z{t),s{t))dt H(x(T)) + G(i/(0)) 


>0, Vz; G A 


(2.9) 

and a 3-tuple {r{-),p{-),q{-)) G L^(n;C([0,T];R)) x L^(n;C([0,T];R)) x L^(0,T;R) 
of solutions to the adjoint FBSDE 


drit) = [cy{t)r{t) - by{t)p{t) - o-y(t)q(t) -f eUq \ify{t) 

+E[cy{t)r{t) - by{t)p{t) - o-y{t)q{t) + E\=o A,4(f)]} df 

+ {cz(f)?'(f) - bz(t)p{t) - cr^{t)q{t) + L\^oi3ifj{t) 

+E[c2(t)r(f) - b2{t)p(t) - cr2{t)q{t) + A,/|(f)]} 
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dp{t) = - {-Cx{t)r{t) + 

+'E[-Cx{t)r{t) +bx{t)p{t) + ax{t)q{t) -E‘i=o dt 

-j-qi^t'jdWt, 

Ko) = LU^/E[^'(y(o))]^ 

p(T) = -<p.(x(T))r(T)-EU^.-(^U^-(nE[x-(T)])+E[/;l(x(T),E[x(T)])]), 

( 2 . 10 ) 

such that 

s{t) = argmax'H{t,&{t),s,r{t),p{t),q{t),Xo,X) a.e. t ^ [0,T], P-a.s. 

sGS 

where the Hamiltonian function H is given by 
n{t,&,s,r,p,q,Ao,\) : = 

-r ■ c{t,@,s) + p ■ b{t,@,s) +q- cr{t,&) - Xif{t,&,s). 

Remark 2.6. As in Remark |2.3[ analogue principles also hold in Theorem |2.5[ 

Remark 2.7. The maximum principle in Theorem 2.5 without state constraints is an 
easy extension of the same result in ||LL14| and follows fhe proof mutatis mutandis. 
Exfending fhe resulf fo allow for sfafe consfrainfs is a sfandard procedure and can 
be found for insfance in |DH14|. 

3. Utilities of mean-variance type 

We are now going fo fif fhe mefhods presenfed in Secfion 2 fo a mean-variance 
framework, i.e. we wanf fo confrol a FBSDE of mean-field type | |2.5| with respect 
to either of fhe following two cases: 


(i). Minimize 


J(m) := -E 


-Var 


U{t,Q{t),s{t))dt + V{x{T)) 


^{t,&{t),s{t))dt + Y{x{T)) 


over 5[0, T] for some risk aversion r > 0. 
(ii). Minimize 


J{u) :=E 


U{t,Q{t),s{t))dt + V{x{T)) 


(3.1) 


(3.2) 


over 5[0, T] subjecf fo a sef of sfafe consfrainfs (compare ( |2.7| ), including sfafe- 
menfs of fhe form 

rT 


Var 


^ 0{t,&{t),s{t))dt + l'{x{T))j<Ro. 

In order fo carry fhis fhrough we infroduce fhe auxiliary process 

q{t) := [ ^{T,&{T),s{T))dT + Y{x{t)), 

Jo 


(3.3) 
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which by Ito's Lemma solves the SDE 




ri{0)=0. 


■Y'(x 


dt + o-{t) ■W'{x{t))dWt, 


(3.4) 

Here we adopt the simpler notational convention 0(1) :=‘I>(t, 0(t),s(f)). By con¬ 
sidering | |2.5| with | |3.4| as an augmented d 5 mamics we may rewrite 0 (or anal¬ 
ogously for the state constraint (|3.3| )as 


J(s) :=E 


- U{t,@{t)Ai))di + V{x{T)) + - E[r^{T)]y 


(3.5) 


An optimal control problem involving the cost functional ||3.5| is within the frame¬ 


work of Secfion 2, in parficular Theorem 2.10 


For fhe Principal-Agenf problem we are inferesfed in fhe following: 


(MVl). Minimize a subjecf fo fhe sfafe consfrainf 

E [ u{t,&{t),s{t))dt + v{x{T)) 
.JO 

for some finife Wq g ]R over 5 [0, T]. 

(MV2). Minimize ||3.2| subjecf fo fhe sfafe consfrainfs 


< Wo, 


Je{s) :=E 


r rT 


u{t,&{t),s{t))dt -h v{x{T)) 


< Wo, 


Jy(s):=Var^^ (p{t,&{t),s{t))dt + \p{x{T))^ < Rq, 
for some finife Wq < 0 and Rq > 0 over 5 [0, T]. 


If is now an easy fask fo formulafe fhe sfochasfic maximum principles fhaf char- 
acferize opfimalify in (MVl) and (MV2) respectively In fhe fwo Corollaries fhaf 
follow we adopf fhe vector nofation: 


B(f) := 


( m \ 

+ b{t) . r (x(f)) + . Y"(x(f ))) 


m :=<,(() (.f,),,) , 


b((): = 

and 


( 

\(p{t) + b{t)-xp'{x{t)) + ?^ 
x(f) := I 


■ rim 

x(f) 

fib) 


m ■■= rt) , 


Corollary 3.1 (The Sfochasfic Maximum Principle for MVl). Let Assumptions 3- 
6 hold and let Y(.) be three times differentiable. If {x{-),y{-),z{-),s{-)) is an optimal 
4-tuple of (MVl), then there exists a vector Ap) G IR^ such that 

Ap >0, Al + \\ = 1, (3.6) 
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and a 3-tuple e 4(n;C([0,T];]R)) x (4(n;C([0,T];]R)))2 x 

(L^(0, T; ]R))^ of solutions to the adjoint FBSDE 

dRf) = {cy{t)R{t) - B]{t) ■ P(f) - lJy{t) ■ Q(f) + \AUy{t) - XpUyit) 

+E[cy{t)R{t) - Bjit) ■ P{t) - i:j{t) ■ Q{t) + A^Uyit) - ApUyit)] }dt 

+ {c,{t)R{t) - Bfit) ■ P{t) - Lj (t) ■ Q{t) + \AUz{t) - ApUz(0 

+E[ci{t)R{t) - BT{t) ■ P{t) - Ljit) ■ Q{t) + - ^pUz{t)]}dWt, 


dP{t) = {c;,( 0 K(f) - Bf(t) ■ P(t) - Lf(t) ■ Q(t) + AAU^it) - ApU:,{t) 

+nCi{t)R{t) - Blit) ■ P{t) - tlf) ■ Q{t) + A^Ms(f) - ApU^it)] }dt + q{t)dWt, 

(3.7) 

where 


RjO) = 0, P{T) 




■R(T) 


{Aav'(x(T))-ApV'(x(T))\ 
{ r{fj{T)-E[tjiT)]) ) 


such that 


s{t) = argmax 'H{t,&{t),s,R{t),P{t),Q{t),AA,Ap) 
sgS 


a.e. t e [0, T], 


P-fl.S. 


where the Hamiltonian function PL is given by 
'H{t,&,s,R,P,Q,AA,Ap) := 

-c{t,©,s) ■ R + B'^{t,©,s) ■ P + 'L^{t,©,s) ■ Q - AAu{t,©,s) + ApU{t,©,s). 


Corollary 3.2 (The Stochastic Maximum Principle for MV 2 ). Let Assumptions 3- 
6 hold and let ipf) be three times differentiable. If (x(-),y(-),z(-),s(-)) is an optimal 
4-tuple of(MV2), then there exists a vector (Ap, Ap, Ay) e IR^ such that 

Ap >0, aI + aI + AI = 1, (3.8) 


satisfying the transversality condition 



ui -E u{t,©it),s{t))dt -\-v{x{Ty}^ 
^V2 - Var 4>it,©{t),sit))dt + i/i(j(T))^ 


> 0 , 


V Ui < Wq, V2 < Rq 


(3.9) 


and a 3-tuple (K(.),P(.),Q(.)) e 4(n;C([0,T];]R)) x (4(n;C([0,T];]R)))2 x 
(L^(0, T; ]R))^ of solutions to the adjoint FBSDE 


dRit) = {cy{t)R{t) - blit) ■ Pit) - crlit) ■ Qit) + ApUyit) + ApUyf) 

+E[cyit)Rit) - bjit) ■ Pit) - crjit) ■ Qit) + ApUyit) + ApUyit)]}dt 

+ {czit)Rit) - blit) ■ Pit) - o-lit) ■ Qit) + Apu.it) + ApU.it) 

+E[c,-(t)K(f) - bJit) ■ Pit) - o-lit) ■ Qit) + ApUiit) + ApU^it)] }dWt, 
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dP(t) = - bUt) ■ P{t) - ■ Qit) + AEUxit) + ApU,{t) 

+E[ci{t)R{t) - blit) ■ Pit) - crj(f) ■ Qit) + Xpuiit) + ApUj(0]}df + Qit)dWt, 

(3.10) 

where 


R(0) =0, P(T) 




■K(T) 


(\pV'ixiT))+\Ev'ixiT))\ 

y 2Xviri{^)-nn{m ) 


such that 


sit) = argmax 'l^(l,0(l),s,R(l),P(f),Q(f),A£,Ap) 
sSS 


a.e. t e [0, T], 


P-fl.S. 


where the Hamiltonian function PL is given by 
PLit,@,s,R,P, Q, Ayi, Ap) := 

—c(l,0,s) ■ R + b^it,©,s) ■ P + cr^(f,0,s) ■ Q — Aem(1,0,s) — Ap!J(f,0,s). 


The transversality condition ( |3.9| specifies which multipliers (Ap,Ay) satisfying 
< |3.8| (given Ap G [0,1]) that are of interest for characterizing optimality in (MV2). 
If we let 

^MV 2 ■= {i^,y) e ]R^ : X < Wo,0 <y < Ro}, 

it is clear by < |3.9| that (J7 e(s), J7y(s)) G This narrows the set of multipliers 

to five distinct cases: 


(i). 

If Jy(s) 

= 0, then Ap = 

= 0, Ay = ^yi - A|„ 

0 < Ap < 1. 

(ii). 

ItJvis) 

= Rq, then Ap 

= 0, Ay = 

Ap, 0 < Ap < 1. 

(iii). 

■ If Je(s) 

II 

u) = 0, then Ap = - 

- y 1 — ApCOS0, 


Ay = — 1 

y 1 — Ap sinfl , 

0 < Ap < 1,0 G [- 

5,0]. 

(iv). 

If Je(s-) 

= Wo and Jv ( 

u) = Rq, then Ap = 

— y 1 — Apcos0, 


Ay = — 1 

y 1 — Ap sin0 , 

0 < Ap < 1,0 G [0, 

f]- 

(v). 

If Je(s-) 

= Wq, then Ap 

= -Jl-Al, Ay = 

= 0, 0 < Ap < 1. 


Each of the cases (i)-(v) are illustrated in Figure]^ 


4. The Principal-Agent Problem 

We are now ready to state the Principal-Agent problem in the framework of 
Sections and and thereby develop a scheme for characterizing optimality. In 
the present literature two t 5 rpes of models seem to be the most popular; The Full In¬ 
formation case and the Hidden Action case. 0ur treatment will focus on the Hidden 
Action regime although similar techniques would apply also to the Full Informa¬ 
tion case. 

The Principal-Agent problem under Hidden Action (or moral hazard) is in¬ 
spired by the seminal paper of Holmstrom and Milgrom | HM871 and is well treated 
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Figure 1. The cases (i)-(v) specifying the multipliers (Ag, Ay) 
that are illustrated by arrows. 


for instance in [ CZ13| and | Will3 1. In what follows we first consider a mean- 
variance version of such a model, using the stochastic maximum principle as our 
main tool. For reasons of tractability (and in line with the present literature) we 
will have to consult weak solutions of SDEs. We clarify this by referring to the 
model as Hidden Action in the weak formulation. 

We will also consider a simpler model under Hidden Action in which the in¬ 
formation set of the Principal is relaxed to a larger set. Such a relaxation does not 
necessarily imply Full Information and we refer to this model as Hidden Contract 
in the strong formulation. 


4.1. Mean-Variance Hidden Action in the weak formulation. Consider a Principal- 
Agent model where output x{t) is modelled as a risky asset solving the SDE: 

r dx{t) =a{t,x{t))dWt, , . 

\ x(0) = 0, 


Here T > 0 and Wf is a 1-dimensional standard Brownian motion defined on the 
filtered probability space (O, F, P). Eor the diffusion we assume a > 0 and 


E Jq cr{t,x{t))^dt < 00 . The agent's level of effort is represented by a process 

e(-), taking values in some predefined subset E C ]R (typically E = [0, e] for some 
non-negative e, or E = R) and is required to belong to the set £[0,T], where 

£[0, T] := {e : [0, T] x O —>■ E; e is F-adapted} 


We consider the case of Hidden Actions meaning that the principal carmot observe 
e(-). Output, however, is public information and observed by both the principal 
and the agent. Before the period starts the principal specifies an F;i:-adapted cash¬ 
flow s(-) (typically non-negative) for all t G [0, T], which compensates the agent 
for costly effort in managing x( ). Just as for the effort we assume s(t) G S for all 
t G [0, T] and some subset SCR and require s(-) G iS[0, T], where 

iS[0, T] := {s : [0, T] X n ^ S; s is F;i:-adapted}. 


The principal is not constrained by any means and can commit to any such process 
s(-) G S[0,T]. 

In this model we consider cost functionals J7p and of the principal and the 
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agent respectively of the following form: 

rT 


and 


JA(e(-);s) := E 


Jp(s(-)) :=-E 


-Var 


10 


u{t,x{t),e{t),s{t))dt + v{x{t)) 


U{t,x{t),s{t))dt + V{xiT)) 


^{t,x{t),s{t))dt + Y{x{T)) 


(4.2) 


(4.3) 


for some given risk aversion r > 0. The agenf will accepf s( ) and sfarf working 
for fhe principal only if fhe parficipafion consfrainf 

JA{e{-)-,s) < Wo, (4.4) 

is fulfilled by s for some, f 5 Tpically negafive, consfanf Wq. We assume incentive 
compatibility, meaning fhaf fhe agenf will acf as fo opfimize J'a in response fo any 
given s( ). The principal's problem is fo minimize jTp under fhe parficipafion con¬ 
sfrainf and incenfive compafibilify. 

A direcf approach fo fhe Principal-Agenf problem as described above is, how¬ 
ever, nof mafhemafically fracfable. Therefore, in line wifh | CZ131 and | Will31 we 
make fhe problem fracfable by using fhe concepf of weak solutions of SDEs. Thaf 
is, rafher fhan having a model in which the agent controls x (■) itself we consider 
fhe density of output, r'^(-), as fhe confrolled d 5 mamics where 

dr{t) = r{t)f{t,x{t),e{t))cr-\t,x{t))dWt, 

P(0) = 1, 


(4.5) 


for a given function / describing producfion rafe and safisfying Assumption 1 in 
SecfionH NofefhatP = £^(Y) where Y(f) = Jg f(T,x(T),e(T)) ■ cr~^(T,x(T))dW(T) 
and £^( ) denofes fhe stochastic exponenfial. The key idea behind fhe weak formu- 
lafion of fhe Hidden Action model, leffing fhe agent control r'^(f) rather than x(t), 
is that it allows us to consider (x)t as a fixed buf random realization (actually 
]F;c = F as a consequence of fhe regularify of u). If r'^( ) is a martingale, which 
follows by assuming for insfance fhe Novikov condition or fhe Benes condifion 
(see. I KS9H p. 200), we have by Girsanov's fheorem fhaf fhe probabilify measure 
dF‘’ defined by 


dP‘^ 

makes fhe process W‘^{t) defined by 

dWf = dWt — f{t, x{t),e{t))a~^{t, x{t))dt 
a P^-Brownian motion. In particular 

dx{t) = f{t,x{t),e{t))dt + a{t,x{t))dWf 


(4.6) 


(4.7) 


(4.8) 


and 


JA{e{-y, s)=E‘^ 


[ u{t,x{t),e{t),s{t))dt + v{x{T)) 

Jo 


= E 


r {t)u{t, x{t),e{t),s{t))dt + r {T)v{x{T)) 


(4.9) 
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We think of the Principal-Agent problem as divided into two coupled problems; 
The Agent's problem and The Principal's problem. 


The Agent's problem (weak formulation): Given any s( ) e 5[0, T] (that we as¬ 
sume fulfills the participation constraint) the Agent's problem is to find a process 
e(') e £[0,T] such that the cost functional 


= E 


T‘^{t)u{t,x{t),e{t),s{t))dt+ T‘^{T)v{x{T)) 


is minimized, subject to the d 3 mamics in 14.51. 


The Principal's problem (strong formulation): Given that the Agent's problem 
has an optimal solution e( ) in the weak formulation the Principal's problem is to 
find a process s(-) G iS[0, T], such that the cost functional 


Jp(s-(-)) := -E 



U{t,x{t),s{t))dt + V{xiT)) 


+ ^Var <T>it,xit),sit))dt + Wix{T))^ , 


is minimized and 


Xi(e(-);s) = E 


u{t,x{t),e{t),s{t))dt + v{x{T)) 


< Wo, 


subject to the d 5 mamics 

dx{t) = cr{t,x{t))dWt, t G (0,T], 
x(0) =0. 

Remark 4.1. Here we have chosen to formulate the Principal's problem in the 
strong form rather than in the weak form, which seems to be most common in 
the literature. However, as pointed out in | GZ13| , because of adaptiveness this 
approach can be problematic in certain models. This is a fact that one should be 
aware of. 


In this context the following definition is natural. 

Definition 4.2. An optimal contract is a pair (e(-),s(-)) G £[0,T] x iS[0, T] obtained 
by sequentially solving first the Agent's- and then the Principal's problem. 

In game theoretic terminology an optimal contract can thus be thought of as a 
Stackelberg-equilibrium in a two-player non-zero-sum game. 

It is important to note that even though the principal cannot observe the agent's 
effort, he/she can still offer the agent a contract by suggesting a choice of effort 
e( ) and a compensation s( ). By incentive compatibility, however, the principal 
knows that the agent only will follow such a contract if the suggested effort solves 
the agent's problem. To find the optimal effort, e( ), the principal must have infor¬ 
mation of the agent's preferences, i.e. the functions u and v. The realism of such 
an assumption is indeed questionable but nevertheless necessary in our formula¬ 
tion due to the participation constraint. In order to make the intuition clear and to 
avoid any confusion we adopt the convention that the principal has full informa¬ 
tion of the agent's preferences u and v. This gives a tractable way of thinking of 
how actual contracting is realized. 
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Thus, the principal is able to predict the optimal effort e(-) of fhe agenf's prob¬ 
lem and fhereby suggesf an optimal confracf (e(-),s(-)), ifif exisfs. 

The idea is fo apply fhe mefhods from Secfion|^fo characferize opfimal con- 
fracfs in fhe general Principal-Agenf model presenfed above. However, since fhe 
confrol variable e figures in fhe diffusion of ( |4.5| we require fhe following convex- 
ify assumption in order fo avoid a second order adjoinf process in fhe maximum 
principle: 

Assumtion 7: The sef E C M is convex. 


The Agenf's Hamiltonian in fhe weak formulafion is 

nA{t,x,r,e,p,q,s) :=q-r- - T"' u{t,x,e,s), 


(4.10) 


and by Theorem |2 .1 1 any opfimal confrol e(f) solving fhe Agenf's problem musf 
maximise 'Ha poinfwisely. The pair ipi-),q{-)) solves fhe Agenf's adjoinf BSDE: 


dp(t) = - ^^q{t) 
P{T) = -v^{x{T)) 


cr{t,x{t)) 


— u{t,x{t),e{t),s{t)) > dt + q{t)dWt, 


(4.11) 


If / and u bofh are differentiable in the e variable and we assume that e(-) & int(E), 
maximizing Ha translates into the first order condition 


q(t) = cr(t,x(t)) 


Ue(t,x(t),e(t),s(t)) 

fe{t,x{t),e{t)) 


(4.12) 


which is in agreement with [ Will3| . Before proceeding fo fhe Principal's problem 
we assume solvabilify of e in ( 4.12| and we wrife 

e{t) = e*{t,x{t),q{t),s{t)), 

where e* : 1R+ x ^ IR is a funcfion having sufficient regularity to allow for fhe 
exisfence of a unique solution fo fhe FBSDE1 4.13| below. Based on fhe informafion 
given by e* fhe principal wishes fo minimize fhe cosf jTp by selecfing a process s (■) 
respecting < |4.4[ . The d 3 mamics of fhe corresponding confrol problem is, in confrasf 
fo fhe SDE of fhe agenf's problem, a FBSDE builf up by fhe outpuf SDE coupled fo 
fhe agenf's adjoinf BSDE. More precisely: 


{q{t) ■ _ u{t,x{t),e*{t,x{t),q{t),s{t)),s{t 


dt 


dx{t) = (T{t,x{t))dWt, 
dp{t) = - 

+q{t)dWt, 

^ x(0)=0, p{T) =-Vx{x{T)). 

(4.13) 

In order fo characferize cash-flow opfimalify in fhe Principal's problem we apply 
Theorem 13.II The Hamilfonian reads 

Hp{t,X,q,s,R, Pi,P2/Qi/ Qi,^p,^ a) '■= 

|-£?- -HM(f,x,e*(f,x,(;,s),s)|-hP 2 ■ (‘l>(f,x,s)-h ^^^Y"(x)) 

-FQi ■ cr{t,x) -h Qz ■ cr{t,x)W{x) - A ,4 ■ u{t,x,e*{t,x,q,s),s) + \p ■ U{t,x,s}, 

(4.14) 
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and for any optimal 4-tuple (x(-),p(-),q(-),s(-)) we have the existence of Lagrange 
multipliers A^, Ap G IR satisfying the conditions in Theorem a The adjoint 
processes (K(■)/ (')' Qi (')' ^2 (■)' Q 2 (■)) solve the FBSDE | |3.7[ , in which case 

s(f) = argmax 
ssS 

Before stating the full characterization of optimal contracts in the Mean-Variance 
Principal-Agent problem under Hidden Action we introduce the following tech¬ 
nical assumption: 

(PAD. All functions involved in the Agent's problem satisfy Assumption 1 from 
Section and the density of output is a martingale. The functions defining the 
Principal's problem (including composition with the map e* ) satisfy Assumptions 
2-6, also from Section]^ and Y is three times differentiable. 


Theorem 4.3. Let the statements in (PAl) and Assumption 7 hold and consider the Mean- 
Variance Principal-Agent problem under Hidden Actions with risk aversion r > 0 and 
participation constraint defined by Wq < 0. Then, if {e{-),s{-)) is an optimal contract 
there exist numbers A, 4 , Ap G IR such that 

Ap >0, A^ -H Ap = 1, 


apair {p{-),q{-)) G Lr(0,T;R) x solving the SDE in {4.11^ and a quin 


tuple {R{-),Pi{-),P 2 i-),Qi{-),Q 2 {-)) e _^(n;C([0,T];R))xL2,(n;C([0,T];]R))x 


Lr(0, T;R) solving the adjoint FBSDE {3.7^ defined by {4.13^ such that, sequentially. 


and 


e{t) = argmax FLA{i,x{t),D{t),e,q{t),s{t)), 

eSE 


s(t) = argmax 'Hp{t,x{t),q{t),s,R{t),Pi{t),Qi{t),P 2 {t),Q 2 it),Ap,\A), 
ssS 


with Hamiltonians Ft a and Ftp as in ^4.10^ and (\4.14* respectively. 


4.2. Hidden Contract in the strong formulation. We are now going to study a 
different t 5 rpe of Mean-Variance Principal-Agent problems called Hidden Contract 
models (introduced in | DH14[). Comparing to the Hidden Action model in Section 


4.1 


the Hidden Contracts differ in two key aspects. First we relax the information 
set of the Principal from to the full filtration generated by the Brownian mo¬ 
tion. Secondly we treat the process s (■) as hidden, meaning that the Agent reacts 
to the provided cash-flow given as an F-adapted process, without being aware of 
the underlying dependence of output. This explains the name Hidden Contract. 

The fact that the underlying mathematical structure of s (■) is unknown to the 
Agent in the Hidden Contract model motivates the relevance of a Mean-Variance 
framework by an extended participation constraint (compared to < |4.4| ). By re¬ 
quiring an upper bound for the variance of for instance the expected accumulated 
wealth provided by s (■) the Agent can protect him/her-self from undesirable high 
levels of risk. The setup goes as follows: 

Consider a Principal-Agent model in which output x{t) is modelled as a risky 
asset solving the SDE 


dx{t) = f{t,x{t),e{t))dta{t,x{t))dWt, te (0,T], 

x(0) = 0. 


(4.15) 
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Here T > 0 and YJt is a 1-dimensional standard Brownian motion defined on the 
filtered probability space (O, F, P). The functions / and a represent production 
rate and volatility respectively, and we assume both of fhem fo safisfy Assumpfion 
1 from fhe Secfion|^ Jusf as for fhe Hidden Action case we require any admissible 
efforf process e( ) fo be in £[0,T]. For fhe admissible cash-flows, however, we 
enlarge iS[0, T] (due fo fhe exfended flow of informafion fo fhe Principal) fo 


5[0, T] := {s : [0, T] X n —> S; s is F-adapfed}. 


We consider fhe cosf funcfionals 


JAie{-)-,s) := E 


u{t,x{t),e{t),s{t))dt + v{x{T)) 


(4.16) 


and 


Jp(s(-)) :=E 


U{t,x{t),s{t))dt + V{x{T)) 


and fhe parficipation consfrainf: 

rT 

JA{e{-);s) := E 


u{t,x{t),e{t),s{t))dt + v{x{T)) 
TA{e{-)-,s) := Var (j){t,x{t),e{t),s{t))dt + xp{x{T)) 


< Wo, 

< Rq- 


(4.17) 


(4.18) 


Jusf as for fhe Hidden Acfion case in Section 4.1 we consider fhe Agenf's- and fhe 
Principal's problem sequentially. The precise statements are: 


The Agent's Problem. Given any s( ) G iS[0, T] (fulfilling fhe participation con¬ 
sfrainf) fhe Agenf's problem is fo find a process e(-) G £[0, T] minimizing (4.161. 


The Principal's Problem. Given fhaf fhe Agenf's problem has an optimal solu¬ 
tion e(-) fhe Principal's problem is fo find a process s(-) G iS[0, T] minimizing fhe 
cosf funcfional (4.17| subjecf fo fhe participation consfrainf (4.181. 


The mafhemafical virfue of Hidden Gonfracfs is fhe possibilify of working solely 
in fhe sfrong formulafion. For fhe Agenf's problem we are facing fhe Hamilfonian 


'HA{t,x,e,p,q,s) := p- f{t,x,e) + q- a{t,x) -u{t,x,e,s). 


(4.19) 


Therefore, by Theorem 2.1 we have for any optimal pair (x(-),e(-)) fhe exisfence 


of adjoinf processes {pCJTqi')) solving fhe BSDE: 


I dp{t) = - {fx(t,x(t),e(t)}p(t)+crx(t,x(t})q(t) - Ux{t,x{t),e{t))} dt + q{t}dWt, 
\ p(T) = -vA,x{T))> 

(4.20) 

and fhe characferization 


e{t) = argmax'HAit,x{t),e,p{t),q{t),s{t)), (4.21) 

e€E 

for a.e. t G [0, T] and P-a.s. 

As in fhe Hidden Gonfracf case we proceed info fhe Principal's problem by 
assuming the existence of a function e* such fhaf St = e*{t,x{t),p[t),q{t),s{t)) 
(having sufficient regularity to allow for exisfence and uniqueness of a solution fo 
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< |4.22[ ). The Principal is facing the problem of minimizing Jp subject to 1 4.18) by 
controlling the following FBSDE: 

dp{t) = - {fx{t,x{t),e*{t,x{t),p{t),q{t),s{t)))p{t) + (7:c{t,x{t))q{t) 

-Ux{t,x{t),e*{t,x{t),p{t),q{t),s{t)))}dt + q{t)dWt, 
x{0)=0, p{T) =-Vx{x{T)). 

(4.22) 

We now apply Theorem |3.2| in order to characterize optimal cash-flows in the Prin¬ 
cipal's problem. The associated Hamiltonian is 

'Hp{t,x, p, q, s, R,Pi, P2, Qi, Qi, ^p) = 

R- {fx{t,x,e{t,x,p,q,s))p + (7x{t,x)q - Ux{t,x,e{t,x,p,q,s),s)) 

+Pi ■ f{t,x,e{t,x,p,q,s))+P 2 ■ |^(t,x,e(t,x,p,t?,s),s) 

+f{t,X,e{t,X, p,q,s))xp'{x) + -h Qi ■ (r{t,x) + Q 2 ■ cr{t,x)xp'{x) 

—Ae ■ u{t,x,e{t,x,p,q,s),s) — Ap ■U{t,x,s). 

(4.23) 

For any optimal 4-tuple {x{-), p{-), q{-),s{-)) of the Principal's problem we have 
the existence of Fagrange multipliers Ap, Ay, Ap G IR satisfying either of the con¬ 
ditions (i)-(v) in Section]^ with Ap > 0 and 

Ap Ay -|- Ap = 1, 


and a triple of adjoint processes (R(-),P(-), Q(-)) solving the FBSDF (3.101 so that 


s(t) = argmax 'Hp{t,x{t),p{t),q{t),s,R{t),Pi{t),P 2 {t),Qi{t),Q 2 {t),XE^^p)- 

ses 

For the full characterization of optimality we require the following technical as¬ 
sumption: 

(PA2). All functions involved in the Agent's problem satisfy the Assumption 1 
from Section 1^ The functions defining the Principal's problem (including compo¬ 
sition with the map e*) satisfy the Assumptions 2-6, also from Section and i/i is 
three times differentiable. 


Theorem 4.4. Let the statements in (PA2) hold and consider the Mean-Variance Principal- 
Agent problem under Hidden Contract with participation constraints defined by the given 
parameters Wg < 0 and Rq > 0. Then, if {e{-),s{-)) is an optimal contract there exist 
numbers Ap, Ay, Ap G IR such that 

^ 0, Ap -|- Ay -|- Ap = 1, 


apair {p{-),q{-)) G L^(0,T;]R) x (L^(0, T;^)) solving the BSDE in {4.20^ and a quin- 
tuple{R{-),Pi{-),P 2 {-),Qi{-),Q 2 {-)) G^(n;C([0,T];R))x4(n;C([0,T];]R))x 
L^(0, T; R) solving the adjoint FBSDE {3.10 ' defined by {4.22 ' such that, sequentially. 


and 


e{t) = argmax 'HAit,x{t),e,p{t),q{t),s{t)), 


s(t) = argmax 'Hp{t,x{t),p{t),q{t),s,R{t),Pi{t),P 2 {t),Qi{t),Q 2 {t),AE,^v,^p)- 

sGS 
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with Hamiltonians Ha and Hp as in (4.19 • and {4.23 ' respectively. 


5. A Solved Example in the Case of Hidden Contracts 

We now illustrate the method of Section by considering a concrete example 
of Hidden Confracf fype. In order fo find explicif solufions we choose a linear- 
quadratic sefup. As a resulf we gef opfimal confracfs adapfed fo fhe filfrafion 
generafed by outpuf. 

Consider fhe following d 5 mamics of producfion, 

f dx{t) = {ax{t) + be{t))dt + vdWt, f C (0,T], 

\ x(0) =0, a,b and cr > 0, 


and lef fhe preferences of fhe agenf and fhe principal be described by quadratic 
utility functions: 


JA{e{-y, 


Jp{s{-)) 



2 


(5.1) 

(5.2) 


Note that we are following fhe convenfion of Secfion fo consider cosf- rafher 
fhan payoff-funcfionals. Thus, fhe Agenf's ufilify funcfion should be inferprefed 
as a desire fo mainfain a level of effort close to the compensation given by the 
cash-flow. We fhink of fhe paramefers a > 0 and fi > 0 as bonus facfors of fofal 
producfion af fime T. For fhe participafion consfrainf we require any admissible 
cash-flow s(f) fo satisfy fhe following: 


/ JAie{-ys} <Wo, 

\ Var(x(T)) <Ro, 


(5.3) 


where Wq < 0, Rq > 0 and e (■) denofes fhe opfimal efforf policy of fhe agenf given 

s(-). 

Assume fhaf fhe principal offers fhe agenf s( ) over fhe period 0 < t < T. The 
Hamilfonian funcfion of fhe agenf is 


Ha {x,e,p,q,s) := p ■ {ax + be) + q ■ a - 


(s - e)2 


so 

= bp + s — e = 0 and e(t) = bp(t) + s{t), (5.4) 

ae 

where fhe pair {p,q) solves fhe adjoinf equafion 


dp{t) = —ap{t)dt + q{t)dWt, 
p{T) = ocx{T). 


Turning fo fhe principal's problem we wanf fo confrol fhe FBSDE 

( dx{t) = (flx(f) -|- b^p{t) + bs{t))dt + cdWt, 

< dp{t) =—ap{t)dt + q{t)dWt, 

[ x(0) =0,p(T) =ax(T), 


(5.5) 
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Optimally with respect to the cost function < |5.2| and the participation constraint 
| |5.3| . The Principal's Hamiltonian is 

'Hp(x, p,s, R, Pi, P2, Qi, Q2, ^p) '■= 

-ap ■ R + {ax + b'^p + bs) ■ Pi + {s + ax + b^p + bs) ■ P 2 + cr- (Qi + Q 2 ) (5.6) 

-Ae-^-Ap-^ 


so 


dPlp 


bPi + {1 + b)P 2 — ?^ps and s(t) 


bPi{t) + {l + b)P2it) 
Ap 


where the quintuple {R{t),Pi{t),P2{t), Qi{t), Q 2 (f)) solves the adjoint FBSDE: 

dR{t) = {aR{t) - b^{Pi{t) + P 2 {t)) + /VEb^p{t))dt, 
dPi{t) = -a{Pi{t) + P2(t))dt + Qi{t)dWt, 

< dP2{t) = Q2{t)dWt, (5.7) 

RiO) = 0, 

_ Pi(T) = -xR{T) + (aAe + /lAp)x(T), P2{T) = 2Av(]E[i7(T)] - i/(T)). 


In this case, however, the auxiliary process t]{t) is the same as the output x{t) in 
which case PiiT) = 2Ay(E[x(T)] — x(T)). To solve the BSDE in (5.7 1 we can make 
a general linear ansatz: 


r p{t) = An{t)x{t) + Bn{t)R{t)+A 2 i{t)E[x{t)] + B 2 i{t)E[R{t)], 

I Pi{t) = Ai 2 it)x(t) + Bi 2 {t)R{t) + A 22 {t)E[xit)] + B 22 (t)E[R(t)], (5.8) 

[ Piit) = Ais{t)x{t) + Bi3(f)K(f) + A23{t)E[xit)] + B23(f)E[K(f)]. 


Using the standard procedure with Ito's lemma it is elementary (but tedious) 
to derive a set of twelve coupled Riccafi equafions for fhe coefficienfs in ( |5.8| . 
A numerical example is presenfed in Eigure below. We gef fhe unique semi- 



Eigure 2. Solution curves of (5.71 wifh paramefer values chosen 


as: a = b = a = 1, oi = 0.2, jS = 1, Ap = 0.1, F = 7t/2, T = 0.03. 
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explicit solution to the optimal contract {e{t),s{t)}, driven by the optimal d 5 mam- 
ics What remains is to find a feasible fripple (Ag, Ay, Ap) so fhaf fhe 

opfimal confracf fulfills fhe parficipafion consfrainf in | |5.3| . One way of finding 
such a friple is for insfance by sfochasfic simulafion of (x(f), R{t)) (e.g. a simple 
Euler-Maruyama scheme) and fhen esfimafe fhe payoff and fhe variance in | |5.3| by 
Monfe-Carlo fechniques for differenf values of Ap. In Fig. |^we have included fhe 
resulfs of such a scheme corresponding to case (iv) of fhe transversalify condifion 
in Corollary |3.2| Nofe fhat R{t) safisfies fhe linear ODE 



Figure 3. Monfe-Carlo simulations of j7A(e(');s), J7p(s(-)) and 
Var(x(T)) as functions of Ap and 9 (relating fo Ap and Ay via case 
(iv)) based on 10^ sample pafhs at each point. Parameter values: 
a = b = a = l,ci = 0.2, = 1,T = 0.03. 

( ^ + {b^Bi 2 + - Apb^Bii - a)R{t) = - b^Ai 2 - b^Ai 3 )x{t), 

1 R{0) = 0, 

(5.9) 

so 

R{t) = 

/q exp {/q b^Bi 2 + b^Bi 3 - Apb^Bn - a du] ■ (Apb^An - b'^Ai 2 - b^Ai 3 )xds 
exp I/g b'^Bu + b2Bi3 - Ae^^Bii - a dsj 

and is by that -adapted. Therefore, in fhis model the opfimal confracf {e(f),s(f)} 
is Fx-adapfed and coincides with the corresponding strong solution to the Hidden 
Action problem, i.e. when the information set of fhe Principal is generafed by ouf- 
puf. 
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